GKE AI Labs

Unlock Scalable and Efficient AI Workloads with Google Kubernetes Engine (GKE)

Experiment with the latest tools and practices for deploying and scaling AI on GKE

Discover practical examples of AI Agents deployments and scaling

Quickly launch pre-configured solutions

Follow structured tutorials to master key concepts and skills

AI/ML Use Cases

Explore how Google Kubernetes Engine (GKE) empowers the entire AI/ML lifecycle, from initial experimentation to scalable production deployments. Discover practical examples and best practices for leveraging GKE to accelerate your AI/ML initiatives.

Experimentation
Leverage containerized environments to manage dependencies and simplify reproducibility. Explore examples of using GKE for distributed training and hyperparameter tuning, enabling faster experimentation cycles.
Creating Inference Checkpoints Fine-tuning Gemma 3-1B-it on L4
Orchestration
Streamline your AI/ML workflows with GKE's powerful orchestration capabilities. Manage complex pipelines, schedule jobs, and automate resource allocation.
Workflow orchestration GKE cross region capacity chasing with SkyPilot DWS
Evaluation
Ensure the quality and performance of your AI/ML models with GKE's robust evaluation infrastructure. Deploy evaluation services and dashboards to monitor key metrics and track model performance.
Deploying a containerized agent built with the Google Agent Development Kit (ADK) that uses VertexAI API Building Agents with Agent Development Kit (ADK) on GKE Autopilot cluster using Self-Hosted LLM Building Agents with Agent Development Kit (ADK) on GKE using Ray Serve for Self-Hosted LLMs
Serving
Deploy and scale your trained AI/ML models with GKE's production-ready serving infrastructure. Leverage containerized serving solutions to deliver low-latency predictions and handle high traffic volumes.
Kserve Deploying a Persistent Chatbot on Google Cloud Platform with LangChain, Streamlit, and IAP Llamaindex in GKE cluster

Community & feedback

Explore a curated selection of impactful AI/ML projects and groundbreaking research from our community. These innovative contributions are shaping the future of AI. Explore a curated selection of impactful AI/ML projects and groundbreaking research from our community. These innovative contributions are shaping the future of AI.Explore a curated selection of impactful AI/ML projects and groundbreaking research from our community. These innovative contributions are shaping the future of AI.

Share your knowledge and help us improve our learning materials.